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On Turtber 
^xaminatioiidf 
"On Turtber 
^xaminatioti" 

This paper was written as one f^EA 
response to the Report of the ^dvi- 
st>ry Pane! on the Scholastic' Aptitude 
Test Score Decline, We extend our ap- 
preciation yo Roger m Shuy and 
Nancy^M. Yqnofsky, Jf the Center' 
for Applied Lingupucs, who were 
consultants to the^itff on its prepara- 
tion. The Association's Initial response 
to the panel^eport came from Presi- 
dent John Ryor, whose editorial from 
the November-E)ecember 1977 issue of 
^ Xoday's^ducation is reprinted in this 
bookm , ' r 

Thfe Tcport of the Advisory Panef 
..QSLthe Scholastic Aptitude Test Score 
Online has been entitled On Further, 
xamination. This title is appropriate 
in two ways. First;; the panel has re- 
/ported to the public the results? of its 
extensive "furthep examination* of * 
the problem. Second, the examination 
is by no means finished. Many' ques- 
tions remain unanswered, questions 
that warrant— an;! demand— "further 
examination.** 

The panel, is to be commended foX^ 
its lack of indictment. Many questions 
were, raised, many analyses under- 
taken, many theories entertained^ 
tilany discussions^>.held, ^ome experts 
consulted; but even with all of the ' 
above, no single reason emerged as 
THE REASON P6v the test score decline. 
The report reflects oh why the iseorcs 
have declined but by jio means ex- 
plains aH the reasons forlhis decline. 
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The College Entfance Examination 
Board (CEEB) and the 'Educational 
Testing Service (EJS) convened the 
advisory pangl two years ago. Its 
charge was to examine the Scholastic 
Aptitude "^Test (SAT) scor6 decline 
over the last 14 years. More specifical- 
ly, the panel was charged with .deter- 
mining the reason(s) for the 49- point 
drop in the Verbal SAT sco;es and the 
32-poii^r drop in the 'Mathematical 
SAT scores. v 

A^he panel's inquiry j^ogressed, it 
became quite clear tha( it would not 
be able, to identify or explain all the 
reasons ^or the (declining test scores.^ 
It has done, however, a reasonable'^ 
job of presenting its findings about 
what has 'happened pver the last 14 
years. It "has reflected on* the SAT 
itsetf, other standardized tests, the 
populations taking the {ests, educa- 
tional changes in school practices and 
staffing , patterns,, and a variety of 
social forces. 

In attempting to discuss wh)( Vtie 
test scores have declined, the panel 
states, "Fourteen years of uiunter- 
rupted decline in the SAT scares 
create the illusion that theje is some 
sin^c force or closely related set of 
forces at work here. This isa*t the 
case. The^decline has developed in two 
distinct stages...** Cp. 13). 

' The first stage of the decline took 
place between 1963 and 1970 and is 
described as the period of "composi- 
tional change.** During this time an 
increasing number of students became 
^ te$t takers apd thus potential college 
students. This larger group included 
'more women, more minorities, more 
'representatives of all socioeconomic, 
levels, and high school students with 
lower acadefiiic ranking. This period 



also marked the beginning of many 
more opportunities for students to go 
to college, which can be attributed ^o 
factors such as the advent of open 
admissions, th^ establishment of two- 
year colleges, 'and increased scholar- 
r ship support for minorities. 

The test store^ decline x:anno^ be 
attributed solely to this copippsitional 
change in the test-taking group, how- 

* ever. The panel has emphasized that 
other factors in scl\ools ^nbHn society ■ 
must also be considered in order to . 

, understand the decline.. Hence, the^ 
second stage, from. 1970 to 1977, is 
regarded as the period of pervasive 
change,** -a geriod characterized by 
uncertainty and unrest in our society. 
The remainder of this statement will 
address itself to the panel's analysis of 
what has contributed t6 ' "pervasive' 
change.** The panel report* notes that 
this c^angye has a tendency to become 
so elusive th^t a "now you see- it, now 
you don't** phenomenon often occurs. ^ 
\ **So much has happened"'^ that m^ 
have affected this record that ther«B 
no way of telling 'what did; the only 
evidence is circumstantial, leaving it 
hard to distinguish cause from j:oin- 
cidence**.(p. 25). . ' 

In ^contrast with these .carefully 
qualified , findings, the panel report 

• was interpreted^ rather loosely by the 
press. A repr^entative sample of 
new$.articles, editorials, and letters to 
tlie editpr reveals that the. public has 
not been given aii-.acCurate picture of 

•tfie report. The Washington Star, for 
example, editorialized that ihp' panel* 
was "almost too judicious in its 
nuances, distinctions and imponder- 

.ables to account for th^ frying pff of 
scores.** Perhaps the press is the body 
referred to ';in the repo.rt itself when 



^he-panel*^«ote5 that three* false as- 





^sumptions underline most theories for 
SAT score declines, the first of whicK 
is that there is .a simple, clear answer 
^0 the problem. The, Star takes the, 
NEA PresMent to-ta&k for his criti- 
cisms Qf the SAT, observing that if 
teachersX develop thdr own t.estsjt 
would bd **a classic case of the in- 
mates running the asylum."** In that 
the panel report does not implicate 
teacl^ers in any major way, such flam- 
boyant verbiage by the ^tdr^ is com- 
pletely uncalled for. 

_ Education, as every teachec^knows, 
suffers today from the attitudes of 'the 
general public, which thinks it knows 
all there is tq know about education, 
that special thought^ study, or experi- 
ence with educfltiop is- hot needed to 
qualify one to /make gra;idiose" state- 
ments about education! Since 
educators appear^ to be under siege, 
careless interpi^tation of an important 
report such as On Further Examina- 
tion can be dama^ng ,to the profes- 
sion.' It is '{or this reasorrthat this 
paper has been prepared. 

On Further Examination concludes 
with the observation that readers who 
turn to the summary of the report for 
a quick and easy picture of the pat\ePs 
view are themselves guilty of the sort 
of practice which may have contrib- 
uted to SAT score decline. This paper 
is not a substitute for the report itseTf, 
which is a well- written. and important 
document.* RathePrvit will analyze; 

' comment onj and set the_^repprt in the 
context of current American educd- 

- tional practice. Jt will note in particu- 
lar what the panel has to say ^bout 
the SAT^ about teaching, and about 
^sel^cted aspects of< our society. It will 

*0n Further Examinalion, ftcpQrt of the A(ftj$ory Panel ort 
the^ Scholastic Aptitude Test S^ore Oechne. may be ordered 
from .College Board l^ublication) Order), 6ox 2^15. Prince- 
ton, NJ 06540. Tftc pnce is S4. 



conclude, with^a brief discussion about 
the future /including a set/of questions 
for even **.fiirther examination.** 

I About the SAT 

, * In order to, ade'lquately discuss any 
,test, it'is jimportant td focus on the 
foHowing Uhree issues': "reliability of 
measurenibnt, content validitfy, and 
interpretation of results. Stated ahoth- , 
er way, the construct/on of any testing 
instrument must consistt-of three com- 
' ponents: I what Is' measured, how, it is 
measureq,-and what the results mean. 

I. Reliability 

The panel ha^ great admiration for 
the reliability ^^f the^SAT. Reliability 
• in testing is, the degree of consistency 
between two measures of the .same 
thing. Assuring reliability is probably 
• what thp CEEB and thfe<E|3 do be§J. 
.^For example, the SAT tests compare>a 
^ test t^^r's capacities with those of his 
^eers'and with students who took tjie 
test before. The test is also correlated 
with the student*s grades in hi^h school 
aiTd, i\ is claimed,^ is actually 'improv- 
ing asx a predictor of success in the 
first year' of college.' Likewise, dif- 
ferent \forms of the test can be mea- 
sured against each other for reliability. ' 
From this, the panel ooncludes that^ 
the*SAT4s: not out of line with teach- 
ing practice in the secondary school. 

The NBA has no question about the 
efficiency and integrity of the'ETS to 
do what it does ^st. And the panel is 
no doubt correct in its admiration for 
the lattentiVir' to reliability, which the 
SAT contains. But ttfis is not reqlly^. 
saving very much because any test can 
b^ technically reliable and still totally 
fail/ to' measure what ^it intends to 
measure.". The attractiveness of relia- 
bility is attached to the fact that it can 
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be quantified, thus giving the air of 
scientific respectability. 

Invalidity . ' 

T^e panel report deals very little 
with the issue of coqtent validity de- 
spite \^e f^ct that this is the central 
issue to, tho^e involved in standardized 
testing today. Recent federal hearings 
related to the language ass^m^t of 
bilingual children in New York, Chi- 
cago, Philadelphia, and many other 
school systems have stressed this basic 
issue: "Does the test n^easure whafit 
says it measures?'* Sin^ the SAT 
claims not to be an achievement test 
,but rather a predictive measure-for- 
success-in-college instrument, content 
validity becomes a\cloudy notion. The 
SAT isj:alled an i^ntelligence test by 
some, since the difference Between 
n:ieasuremehts of intelligence and 
measurements of aptitude are slight at 
best. Xhe basic (and relatively miip)^) 
difference between intelligence and 
aptitude tests is that ^aptitude teats 
measure specific factors r-ather Hhan 
general ones while -intelligence tests 
measure general factors rather Aan 
specific ones. 

Thus the SAT measures verbal and 
mathematical factors rather than all 
tiie {h\ng% .one Might want to call In- 
telligence (provided we could •ever 
agree on wbaLthey are). During the 
history of.the dfevelopment of intelli- 
gence testst the term inteiilgence was 
thought 10 be unchanging and innate. 
To avoid the implication^ of innate^ 
ness, test developers have the term 
aptitude. Since these testsj are used 
primarily to predict School success, 
the term scholastic ^v/as added; One 
could make the case that the SAT is 
really an intelligence test and that, from 
what little Is known about; intelligence 




or how to measure it, the SAT is in- 
, valid. If one takes the l)ositionjhat 
V the SAT is an aptitude test, however, 
^ the test is subject to analysis of why 
\ such group aptitude .tests predict 
\ school achievement. • ^ 

In theory it is possible to distin- 
guish between aptitude and achieve-' 
mentv.One is an innate property and 
, the o\her is accomplishment. Once 
content validity has. been determined, 
it is possible to measure achievement. 
How 10 get at aptitude, hpwever, is 
not so clear. The SAT selected the 
mathematical and verbal areas as a 
locus for measurement. Exactly how 
. this decision -separates achievement 
possibilities from aptitude is still un- 
clear. All xihildren have kno>^dedge, 
memories, and feelings about the sub- 
jects bjeing m§asured. Furthermore, 
distinguishing ,amorfg\SAT verbal * 
aptitude items and those 'items in ver- 
bal abilities on achievement tests is 
^rtually impossible. Wstinguishing 
between aptitude and achievement, 
though possible inuheory, is impos- 
sible in practice. What is more, ability 
. ?^ appears to increase as achievement 
level rises. Why is it, then, that group 
aptitudeHcsts^'can predict achievement? • 
// is highly probafle^4hat they are 
^ really achievement tests. . 

It has been necessary to foflow^.this 
reasoning in order to address the issue 
of content validity. Once verbal achieve- 
m§^t and mathematical achievement 
are recognized as integral to any is- 
sessmenrof the SAT*, .we must^ask the 
question. How do we know that what- 
we are measuring really fnatters? The 
pan^l did not address this"^uestion, 
although to its credit it didwrecognize » 
it as>a legitimate one: **W^ have ac- 
cepted, for purjioses of this inquiry 
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^and report, the trajlitional value base 
.of the SAT^Us validity../* (p. U). 

Perhaps one of the most significant 
statements of the panel report grew 
out 6T a discussion of why scores on 
' tiie Achievement Tests (which may 

. also be elected by SAT takers) did not 
parallel SAT score declines. Scores on 
tests in English Composition, French, 

- Spanish, Biology, Chemistry, and 
Physics have Increased whfle'other sub- • 
jcfjcts reveal Only small declines. Stu- 

. dents who§e scores' went up in -these* 
areas Showed 'd^lines in/SAT verbal* 
scopes and increases ^ in SAT, mathe- 
matics scores. The panel lamented* that • 
it had not been •able to analyze this 
phenomenon fully and concluded^ "It 
is' conceivably important that^the Col- 
lege Board and ETS m^ke much larger 
use of 9utside committees in connec- 
nioi^ with the Achievement Tests than ' 
with the SAT; the counsel sought \$ in 
thp one case from experts in the partic- 
ular disciplines, in the other more fr6m 
psychometricians ^and psychologists** 
(p. 23; italics-added). 

This criticisnt of the SAT, though 
cautious aad' indiiiect; appears to 'be 
One of the central issues in accounting 
for the score decline. The SAT is Ac- 
tually a disguised achievenjent test 
which, in. order to be vilid, must^'bet-^ 
ter address what really matters in the" 
two content fields which it measures. * 
Like most cJbjective tests, it Is/a dis- 

. Crete point measure. That is, certkin 
iteifis are selected from an inventory 

, of all* pos§ihle^know ledge in oi:der to 
represent thdt Jarger knowlj»dge in . 
f«w questions as possible^ Only those ^ 
wTio know the <;ontent of the fields \ 
being measured have the key to con- \ 
tent validity. Test makers create items * i 
to test only after content validity has ' - 
Jpeen established. . 
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3. Cultural Bias 

' The panel 'dismisses the charges of 
culture bias by observing that a defin- 
itive analysis of cultural iias.is virtu- 
ally itnpossible. It appears to the KlEA 
that/definitive analysis of cultural bias 
is Ijo-more difficult than definitive 
analysis of many other, educational 
concepts. Test questiona-.of any sort 
involve matching the assumptions/ 
v'alues, and pre^p'positions of the test 
m'aker against those of the test taker. 

* An understanding of basic principles 
of tankage and culture- make the 
identification of potential cultural 
bias 'available to th,ose who care to 
find it. However,^ even publishers pf 
standardized iests have publJcly^ ad- 
mitted cultural bias and some have 

* made serious-efforts to combat it. By 
this we do nat accuse the SAT of such 

* bias but, rather, disagree with the 
panel about its possible identification. 
Nor da we understand whal the paner 
might mean when i(^6serves, "These 
same^i'fference^ show up on, most- 

^otber standardized tests, and yet this 
proves nothing" (p. liS). Such an ob- 
servation follows the logic^ of saying 

.that because everyone steals^ stealing 
is all right. The panel is quite right, 
hpwever, when'it indicis society as a 
whole for such 'bias. Haviftg said this^ 
it is odd to conclude ^tl?at only the 

'SAT has been ' preserved from, such 

.'bia^. ' . * . . 

' About Teaching 

, In an attempt to further examine 
the* "pervasive change" contributing 
to test score decline, the panel report 
discusses ten issues which directly con- 
cern schools an^d teachers. From the 
teacher's perspective, the reportftj de- , 
clin^in SAT scores reveals a mrtnber 
of important issues. * 
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I. Quality of Instruction 

' The panel clearly recognizes that 
the primary intent of the SAT is to 
predict, success in the first year of (;ol- 
lege. Furthermore, the jfenel explicitly 
notes that the SAT is not intended to 
reflect the adequacy of the student's 
training. Thus tHe^report does not 
authorize or condone criticism of schools 
or individual teachers on the-basis of 
• SAT scores (p. 5). No evidence has 
been presented that would lead to the 
conclusion that the quality of school 
- instructlor^.is what 'is being measured 
on the SAT (p! U). The ^report does 
not deal directly with the^i issue of 
quality of instruction* . 

^ 2. Innovative Jeqching 

' vThe panel ddes not blameMnnova- 
live teaching *f or the decline' m S^T 
scores. It observes, in fio^^e find 
no evidence of ^ny causal relation- 
stiip betw^een what are commonly 
referred to as 'experimental teaching 

. methods^ and' the SAT Score decline'* * 
(p. 41). The panel carefully examined ' 
the results of two different investiga- 
tions into this topic and^notes thdt 
th^re is neither consisfent nor 5\ibstan- 
tial association between student achieve- ^ 
ment and overall level of innovation 
across the grades. It actually advocates ' 
the ^earcl] for new' ways of addressing 
the learning needs of children: "We 
do not read the SAT score ^de'cline as 
an ^struction that education in this ' 
country must or should be more rigid, 
more selective, more rejective, more * 
uniform. Instead, the instruction is 
that education, especially secondary i> 
education, must become still more di- 

^-versified, more varied— but without 
being watered down** (p. 31). The * 
^ panel*s insistence that innovation not ^* 
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cpme to ^ grinding halt is encouraging, 
7 and highly \iesirable. , : , ' 

' 3. ijacit /a Basics » ' 

The panel does not wish their report 
- or-tlie SAT score declines to be thought* 
. to suggest a b^ck-to-6asics movement: 
**In our view,* ^returning to the basics* 
would be wrong unless it include^* full 
reappraisal of what the right basics 
are— taking account of children's dif- 
ferent rates and modes of learning 
^ and their diifferent interests -and plans 
for the future. The need is not to re- 
vert to uniform drills atid exerfcises^ 
Icommended only by a traditional ped- 
agogy^ but to move ahead to a larger ^ 
^ emphasis .on the fundamentals of 
' learning that can be identified as 
strengthening the base on which all 
, students can build** (pp. 26-27)^ The 
report doe^not suggest a return to the 
^**good old ways,** but it ^Ses encour- 
age a thorough reexamination of what 
the basics really are. 



,4. Literacy . 

The closest the panel comes t^riti- 
cizing the schools occurs in what the., 
panel calls' its "firmest conclusion**: 
that thoughtful and critical reading is 
not being demanded and carried oift, 
' , and that careful writing app^irently 
^ * / has about gone out of style. Although 
• ' the panel 'makes this observation 
rather forcefull>/, the fault for-the sit- 
uation is not laid solely at the feet of 
teachers. The panel argues, in contrast, 
^ that the testing industry itself, which- 
* introduced quantifiable data, even in 
the liberal arts, has contributed to the 
. situation which the declining SAT 
scores illustrate, The NEA is in gen-^ 
eral agreement with the panel that read- 
ing and writing are critical skills which 

^' d 
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educators should address ftvith added 
zest and knowledge/ i. 
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* Automatic Promotion 

Although automatic promotion is 
thought to be a contributing, factor in 
SAT score declines, teachers are nor 
held totally responsible for this in the 
^ panel report. The report says, ill fact, 
that teachers do'not.likS this idea 
^ either. Thus the pand disagrees with., 
those critics of the schools who ob- 
serve .that automatic promotion is the 
invention and fault of teachers. The, 
ananjfe factors which have conspired to 
leay to automatic promotion,(many of . 
which reflect the goals of society as* a ^» , 
whole) must be equally addressed. It 
is ir^teresting to note -that the -panel 
did *not take into consideration the 
available^ research oh late retention,, 
much of which indicafes^that retainiiig 
a child can also have negaUve effects ^ 
on learning, 

^6. Exit Examinations - - > • 

• * # 

The panel flatly denies that evidence ' 
from SAT score declines suggests the 
need for the development of sa-called 
exil examinations at or^'near the end 
of high school: **,..we question an 
equally 'automatic* answer that such 
promotion -should depend entirely on 
scores on still other standardized tests*' - 
(p. 300^ The underlying assumptions \ 
of either minimal competency exami- * i 
nations or exit examinations are ques- , 
tionable at best. Once we establish 
minimal competei\cies we tend to get 
just th^t— minimal competence. One" . 
would hope for considerably^ more ♦ 
than this; To adopt yet another single * \ 
measure of **competence|! appears - 
both unfounded and unnecessary. ^ 
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7. Reduction in Homework 
The question of reduced homework 

was not discussed in any depth by tl|e 
panel but it is interesting to note| th^t ( 
the responsibility for the pre|oA^ed 
reduction in homework is not ;placed 
soljsly on teachers. Although thfe panel 
observes that SAT score declines seem 
to be related to this factor, Mt also * 
concludes that it is impossible^ to tell ^ 
whether reductions in^^siich assign- 
ments are parent or teacher induced. 
In fact, the panel notes that there is 
no quantifiable evidence that home- 
wjork has in fact been reduceSl. 'rl^ , 

8. Individuai Differences 

<^ The- cr^cl^Lissue of individual dif-' 
ferences wai not seriously addressed 
in the report. bifferenc^O^^^^^ 
curves and^ maturation were given 
only cursory attention. One would 
like to assuniejlhat the failure^ to -dis- 
cuss this critical issue was ai) over- 
sight, but perhaps "it was merely re- 
flecting the state of the art in the field 
of educationatf^search.' From the pei> 
spective of the teacher, however^^ it is 
apparent that two stujlents of ^equal 
aptitude may be in a different learning 
growth position at the point ^t which 
the S^KIs taken, grossly differentiat- 
iiTg t^KSCores. Such conditions sftg- 
gest only the obyious:;that research be 
undertaken to see how^well the SAT 
predicts second, third, and final years 
, of college and beyond. The fact that 
the/^AT predicts only the first year 
seems very suspicious; for tflat year Js 
a .major" transition -year for young 
people.' It should be note* that^ the 
panel did little more than casually^ 
mention the important matter of indi- 
vidual differjences, an issue that de- 
served careful attention. 



9. Standardized Teacher Exantin^dons 

The p^el argues against reliance on 
-Standardized t^her e>iamfnations to 
'insure that schools have only qualified ' 
teachers* Despite the fact that approx- , 
imately half of the state legislatures ' 
are considering legislation to require 
such exams as a condition to the'jiif- 
. ing of element^y and secondary 
teachers, tjie panel concludes, "Our . 
increased understanding of the work- 
ings of standardized student examina- 
tions in such situations does nof; 
however, commend exclusive reliance 
on the use of comparable examina- 
^tions for teachers" (p. 33). Thus, the 
panel observes, the declining SAT 
scores should not be Used as evidence 
for the movement toward or foV legis- 
lating teacher examinations. 

\0. Teacher Organizations ' 

The- panel in no way accepts the' 
suggestion that teacher organizations 
such .as the \NEA - or developments^ 
such as collective bargaining have^f 
cbntributed to the decline in SAf- 
scores. It states, in fact.-^that these 
• suggestions * 'of fei'-' little fif" themselves 
as fac-as explaining the decline in the 
test scores is concerned [and] we 
imply nothing (?ne way or the other 
here aboiifc4h6 broader values they 
reflect'\(p. 42). The panel in no way 
casts aspersion on our existence! 



About Sdciety - ^ 

A great deal of what the press has 
stressed from the report concerns the 
blame which society as a whole must 
share for the decline in SAT scores. 
The home environment 'comes in for 
s^rioys questioning along .with issues 
'involving equal education, television, 
and motivation. 
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As usual, however, since the panel 
•was careful not to assign blame where 
' the evidence was ^ot clear, little more 
than reflections 'or hunchejare offered: 
*^**...the SAT should^ no^ecome*' the 
sole thermometer for measuring the' 
health of schools, family, and student" 
*(p.40). ^ ' 

The^anel expressed belief that the 
^traditional relationship^ between the 
.school and the family has w^akene4 
seriously. Broken homes and changing" 
- family relationships, coupled^ with 
changes in ,educational practice^ have 
' VcM^^ted to a strain on the parent- 
teacher f^ati(lnship"Xp. 34). Since na 
/ 'direct pr quai tifiable evideoce*is avail- 
able to suggest that this situation con-' 
tributes to SAT score declines, the 
panel expresses this opinion qnly ^Ik^ 
the most general terms. Improved 
hom^-school relations can contribute 
substantially "" b" a better environment 
for learning, however, the profession 
is n^t expected to bring 'about this 
change.sirigle- landedly-. 

The panel clearly sta*tes that there is 
nothing in the SAT score decline to 
"warrant generalization about what is 
happening to the abilities at large of. 
youth as a whole" (p. -21). Thus any* 
portrayal, of the^ "disintegration of 
youth," so popular' in the current 
literature, cannot be taken as a^re^efc- 
tioh of or a contribution to such decline. * 
In fact," the panel does not fe^l that 
the SAT is a broad measure of the 
general ^ality of youth: "l( tells us 
•nothing aSaut young people's honesty 
and integrity, about whether- they care 
about each other, or about a. lot of 
other things that matter more ^than 
test scores"' (p. 40). This cautious 
understanding of the weakness^f test 
scores, including the SAT, puts such 
scores in proper perspective for stif- • 



dents, parents, administrators, •coun- 
selors, or whoever /else tends to -over- 
rely on such measures, 

*Much has been made of the so-called 
distractions which cl^aracterized 
American lif^' in the past decade , or 
so. Usually nominated are the war In 
Southeast Asia, the dj^di, riots, .the 
corruption in high .j^faces, assassina- 
tions, etc. Television is also included 
as a distraction, but the panel has 
noted that this medium could be used 
effectively for instructional purposes. 
There no rejection of televisiohcin 
the report; only a warning about its 
misuse. 

Like many good things) television 
oan be and often is misused. The 
" panel notes that educators -have the 
responsibility for making effective use 
of its potential rather than rejecting it 
out of hand. ^ 

Sirice much emphasis is placed on 
changes in society that have taken 
place in this country, at least since 
1970, it is noted that the panel sees' 
these changes*reflected ip our youth: 

.students entering college during ' 
that period had gone tfirough five or 
six years of national disillusionment, 
especially for young people, virtually ^ 
^ unparalled in Ameridan history** (p. 
. 37). ^ : 

This **decade of distraction** 
should be ^cept in mind while observ- ' 
ing the test score decline. In many ; 
ways^his puts aii additional burden 
on teachers who are asked to pxovide 
.stability while other aspects of life are • 
in chaos. The task of the teacher is 
seen by the panel to be far more com- 
plex than it is often assumed to be. 
Social changes nruist be considered ' 
\when discussing, any issue related to . 
educational effectiveness. 
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> : About the Future - ' ? 

^ We' wish to iTiake an additional' 

>- . commwit on the; title On Further Sjc- . 
mination. As noted earlier, . the panel 

V investigated p&st events thai led lb the 
SAT score decline and reported, Its 

• . current reflections abo.u^ these events. 
All that'^remains ij^o point to the 
' future, ind the 'ijanel did not*lieglect' 
this opportunity. 

^ ^In reviewing the |jast 14 years of 
|esi score* decline-it became increasing- 
ly eyi|dent to the panel that no single 
cause- could be identified. Even 
though ,the panel acknowledges that 
the quality of education MS ..not^^et 
whef^ it should be, it does not despair: 
father, it urges. e4ucatbrs to move 

. ahead to the future. Perhaps jhe ques- 
tion of why SAT scores have declined . 
is the wrong question ,to ask. Perhaps 
it is impossible tp^ahswer adequately. 
But whatever ^Is^nhe report offers, it 
urges those concerned with American 
educaticMi to mak,^. an cjven ""further 

r examination": 

So there is no orte jcause o^Uhe 
SAT score decline, ai. least as ifar as 
we can discern, and';we suspect no 
sifigle pattern of causes. Leading is ' 
too much a part, of Life to have 
expected anything else.^ 

It would be too bad,, further- 
more, if our concentration pn the ^ 
implications pf a decline in the sta- 
tist i car averages oh a Set of stan- 
dardized examination^ ^hpuld seem 
to ignore how incomplete a measure 
this is^ of either educational or 
broader human purpose. While we' 
ask why the scores on college en- 
trance examinations have gone 
down, T.S, Eliot's probing" gpes 
'much deef)er: ** Where is the learn- 
/ ing we have, lost in information? 
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Where is the underst^cjing we have. . 
lost .knowledge? Where is the life 
we have lost in4iving?** 

tet in the panel^s view of it all,- ' 
the facf of the hard asking— of both^. 
kinds of questions-coffers neW/ 
promise of new ariswgrs. We, find ♦ 
nothing in the re^rfrd we have : ' 
reviewed to-distfSurage the xonvic-' \ ' 
' tion that learnings in America can be 
made all that is hoped for it. What ,; 
is clearest is the Reflection,, in the \ . / 
reactions to these test scores and to 
th^poet's lament alike, of renewi^ 
purpc^e to implement these hop^: 
The future continues to seem^^a 
good idea. (p. 48) - - 



If still Further examination is,, given 
to this sut^ect, some or all of 'the ' 
following questions njight be asked: ' 

K /j {fiere an unchanging standard? 

If is uhlikely that eighth-grade 
;^Jeachers would think it appropriate to 
give a test to one eighth-grade class in * ^ 
1970 and to another 'eighth-grade class -^ ^ , 
seven y^e^trs later and expect the dif- 
ference ih scores to say anything use- 
ful. 'What Vould such a difference in 
scores mean? That the teacher is ^ 
bettel^or *wopse? That the students 
have gotten smarter or dumber? *That 
societal values have c)ianged? That 
our knowledge base is different? Can 
we, in fact, compare ^children of one 
set of circuTiistances with those of 
another? The'^CEEB expects teachers 
to believe t^at there is a -^single'^uir- 
changing standard NVhich can be mea- 
sured and compared across time. Is '* 
this a realistic assumption? • ' 

2. What should a predictive test 
predict? , 



Should notjhe predictive power of 
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^ thrS7\T te measured bfeybnd the firsi^ 
year of college? Why jstop there? Why 

• has it not seempd useful- for the.Si^T to" 
predict ^college graduation or spme 
other measure of life success? 

3. How is validity assured? * 

Who should be the arbiters of the 
validity of test questions relating to 
verbd and mathematics abilityj ^hy 
have content experts been used more 
in .the development of achievement 
tests- than the SAT?* How can validity 
be determined for a' test which is said 
to measure aptitude but appears to b? 
measuring achievement? 

4. How is cultural bias determined? 

Why is it tKat the panel declined to 
discuss the issue of cultural bias in 
light df the fact that other test makers 
' not- only have admitted suc^ bias 'but 
' are attempting to correct for it? What 
migUt jhe, panel have done to assess 
bias? Hpw^might the SAT a^oid it? 

5. What instruitigrial changes are in- 
' dicated fts i result ^ of the panel's 

assessment of the SAT score cfe-. 
dine? , 

' The panel has strongly recommended 
that teachers not abandon innovation.. 
They should not go back to ''basics.** 
In light of these recommendations, 
how should instruction change? Shoiiltt 
we be concerneH with developing min- ' 
imal conipetency examinations? Should 
we increase homework? 

6. Should the SAT-aUempt to mea- 
sure thoughtful find critical repding. 
and "careful writing"? 

. Can critical reading actually be 
measured in a time^, pressured en- 
vironment? Who can/adequately deter- 
mine just what is\thoughtfuL and 
critical reading? Can it be measured 



. ' A>y reada^pilify formulae? How can a 
test such as the SAT measure **j:areful 
writing"? Who should determine the 
criteria for just what careful writing 
really Is? □ 
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Tlie recent report of the College 
Entfance Examination Board (CEEB) 
on declining Scholastic Aptitude Test 
(SAT) scores among high school stu- 
dents has done an excellent job in 
highlighting some of the crushing 
problems ^facing students> parent?, 
and teachers— all of whom have a 
high stake in the future of the ^na- 
lion's public schools. The National > 
Education Association shares Concern 

with CEEB over the seriousness of 

^ these prdljlems. No one is more aware 
of them than teachers themselves.^ 

Teachers believe in high standards 
for their students. We also know that ' 
for teachers to teacK, for learning to 
take^place, students "^ust be cvalu-* 
^ted. But we^ believe strongly that 
learning must be ^valudted in a variety * 
of ways. 

Each year, nevertheless, I million 
graSOating seniors— about a quarter 
of their age cohort— 'will have pre-,>^ 
pared for the rite of passage from 
high schoQl'tp college by taking^the . . 
SAT. - ^ . . ^ ^ , ' 
6 For the past 14 years, SAT scores 
h^ve dropped steadily, after remajn- 
ing relatively^stable during the preced- ^ 
ing decade. Verbal scores have dropped ^ 
49 points, from 478* in 1963 to 429 in 
1977; mathematic\^scores, "52 points, 
frbm 502 to 470. yhe question is. 
Why? ^ . 

This fall the College Entrance Ex- 
,amination Board published the* find- ' * 
ings of a Ywo-year . study commis- 
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sioned to investigateithd causes of the 
dirclining scores. The study was 'con- 
•ducted by an advisory panel of 2W 
people chaired by former Secretary of 
Irabor Willardv^Wirtz. It was spon- 
'sored and funded by CEEB and i)y 
the Educational Te'sting Service (ETS) 
—the General Motors of the testing 
. industfyx and sole producer of the 
SAT. (CfeEB^ sponsors the SAT; ETS 
develops and administers it.) 
' The final rejx)rt, entitled On Further 
Examination, ^is impressive, broad-' 
fanging,' and wri^en in immaculate 
prose. Its findings repi^sfent a compre- 
hensive analysis of socfeKatidjdhi^^ 
tional change from 1963 to 1977. 
Ma^iy of the conclusions r6flect condi- 
tions in schools' and societ^^ that 
teachers have "known firsthand for 
'fedrs. 

Despite its studied ''fairness, th^ 
report presents several problems. The 
-j^anel points with pride to the SAT, 
which was designed in 1941 "as ah 
, "unchanging measurement*' to predict 
student performance* in college. (Al^ 
though specific test item^ change from 
'year to year, the SAT remains essen- 
tially the same.) As the report itself 
documents, society and schools have 
changed drastically .since 1963— anci, 
in my t)pinion, certsfinly ^even more 
since 1941— but not the SAT. Is it not 
time to look at the test as well as the 
test results? •/ . 

^ Before discussing the other <jptt)b-' 
Jems with the report, let's look at the 
report findings. 

The report .states that the decline 
^has developed tn '^two distinct stages, 
characterized by significantly different 
balances of... different causal factors." 

In the first stage, 196? tp about 
1970, the report says, as much as 
three-quarters of the decline was caused 
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by the **notable extension and'-^cxp^ji-' 
. sion of educational opporttinity in the 
. United States" >dUring that period. 
This statement jefers to sharp in- 
creases in the proportions of students 
V taking the test- who came from groups 
that have always registered jul^tahtiaUy 
lower- thftn-average scores, on the test' 
—students from families with lower 
socioeconomic status, minorities, and 
women (\yhose averajge ^cores on the 
mathematical portion of the teSt, but 
not on the verbal, hav* been lower 
than mfcn's). 
In the second stage of the clisclinc, 

* after ^ about 1970, there were fewer 
changes In tHe demographic distribu* 
tion of "'the SAT takers. During this 

* time, the decline, in scores swept 

* ' across the board: "scores of tradition-' 
ally higher-scoriD^ studfent^ 4ropped, 
ai)d those of traditionally lower-scoring 
students fell even lower. 

The -panel 'attributes * thre^»fpurths 
* ^ of the decline in this period to tfie 
impact of **pfervasive" social forces, 
w^^se effects it cannot' document, 
pr^isely. It does, however, cite sjx 
s^ts of developments that may have 
^ affected this decline: 

• Characterising the period of sharp- . 
est decline in scores (1872-75) and the 
years immediately before this decline 
as a * 'decade of distraction," the 
panel says that **there is simply no 
way of' knowing -how mnch the 
trauma^'between W67 and 1975 of co^ 

* incident divisive war,... political assas- 
sinati^on,.. .burning cities', and the cor-:^ 

^ ruption of national leadership affected 
the motivation bf the* jroung people... 
and whether there was consequent 
effect on Hieir college entrance exam- 
ination scores. ' The- report cgnjec- 
. tures that **this probably made quite a 
' difference." '^'^ 

ERjC" * 



f 

1 



• The panel al^ points to changes- 
during this pdridd in th^ role of the 
family in the educational process, not- 
ing particularly the* increase in the 
number of children living in Jjomes in 
which two parents are riot present. 
Although lacking definitive evidence 
on this point, the panel concludes that 
the effect of these changes is negative. 

• Noting that **^y age 16 most 
children have spent between 10,000 
and 45,000 hours watching television, 
more time than they have spent in 

the panel surmises that this 
^1^^* activity distracts students from* doing 
homework, competes witl^^schoolin 
in other ways, and has contributed 7o 
^ the decline in SAT score averages; 

'There has been a .^significant 
dispersal of learning activities and em- 
' . phasis in the schools, reflected partic- 
ularly in the. adding of many Elective 
^courses-and ,ar reduction in the number 
of courses , that ^11 studeiijs^f/are 
required to take." The pan^ say?, 
however, that a "broadside coridem-^ 
nation" of electives^ is not the solu-' 
tion; it recommends instead "restoring 
1 the tradition of critical reading and 
careful writing." 

• The report cites clearly observ- 
able evidence of diminished seriousness 
of purpose and attention to mastery 
of sl^ills and knowledge.. .in the 
schools, the home, and* society gener- 

' • ally." It points to the condoning of 
excessive absenteeism," grade inflation, 
. ^automatic promotion from^grade to 
^ grade, less homework, and easier text-' 
books. . 

/ f "There has been an apparent 
marked diminution,*' tjie panel finds, 
**in young people's learning motivation, 
at least-as it appears to be related, di- 
rectly and indirectly, to their perfor- 
^nance on college entrance examinationsf 
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The report does not fault teacher?. 
In fact, the panel shows some under- 
standing of their difficult situation. 
^ At the CEEB press conference to an- • 
nounde the findings, Harold Howe II, 
panel member and former U.S. 'Com* 
missioner of Education, said there is 
Evidence that the job of teaching" is 
tougher today than ever before. The 
report's discussion of teachers is 
jnainly descriptive* npting on the one * 
• Jyhand a drop in the average years of 
' experience of> elementary school 
teachers, but pointing on the other to 
'an increase in teachers* average edu- 
, cational levels, , It also refers to a 
; decrease in pupil-teacher ratios and 
^ cites an increase in teaching salarfes. 

The panel concludes that teachers' 
and school adipinistrators* responsi- 
bility for what has happened "centers 
in their having made more concessions 
because of changfng circumstances 
and demands... than has-been good 
for anybodj^involved. But. this be- 
comes a hard question of hbw much* 
choice they have had and of how the* - 
demands pf a changing student clien- 
tele are best met." 

How are the demands of a changing 
student clientele best met jas they * - 
make the transition from liigh school 
to college? By a standardized multiple- 
.choii:e test, designed in 1941 -apd 
remainiifg virtually unchanged, rigof: ' ^ 
Ofisly guardi^the gates to the nation's 
. colleges? The NEA jloes not think so. . 
While the nation endures a "decade of 
distraction^* the SAT sails- confidently 
into the past. ^ 

In fairness to the panel, if must be, 
said that they were not unaware of 
this issue. While tbey defen/thelSAT 
rigorously on its merits as a predictor' ^ 
of academic college performance, they 
recognize that high school grades are 
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even more valid predictors. They also 
^acknowledge -current broadciVcriticisms 
of the SAT related to common mis- 
uses and abuses of the scores. In'' 
January' 197^7, CEEB issued a set of 
guidelines for avoiding misuse of the 
• scores as measures of the effectiveness 
of elementary an3 secondary educa- 
V. tion in gjperal. The scores%re, never- 
theless, often used erroneously as 
exclusive measurements of individual * 
or institutional quality. The report 
notes that when this occurs, "a very 
real 'relevancy' issue arises." 
, *A far-^more serious consequence of 
test misuse is that it may elicit the cry 
for "back to basics." The report itself 
is provojcing this, kind' of hiisuse. 
When the public and state legislatures 
. look at it, they may see only one 
issue, lower test scores. They m^y not 
heted the panel's thoughtful advige to " 
- schools not to bccome/'more rigid,... 
' more rejective, more uniforii)/' They . 

may not pay attention to the p'anel's 
' observation that "the record may sug- 
gest as mugh about' youth's inherent 
resiliency and the resoui-cefulness of 
the formal educational process under 
unusual circumstances as about 'deter- 
ioration in either personal or institu- 
tional fibers. We have wondered 
sometimes in the course of our inquiry 
why the score declines haven't ,been 
larger." • • 

The panel believes that there is "al- 
most certainly" sonje causal relation--^ 
ship between the shift from traditional / 
courses to eleclives and the decline in 
the SAT verbal scores. But despite its ^ 
warning against "oversimplistic inter- 
pretation of this finding," the knee- 
-jerk response to declining (est scores'- 
may be back to basics. ^ 

A most important part is that virtu- 
ally no one is addressing the question 
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^ of the relationship betweeh'^he SAT 
test and curriculum as it exists in 
16,500 school districts in the United 
States. The problem does not ^e in 
identifying and explaining causes for 
the drop in SAT scores; the committee 
did' that and did it well. A fundamen- 
— tal* value question must be answered: 
Should a SAT test which hasn't 
changed significantly in 36 years ^ be 
allowed to become a major determi- 
nant of school curriculum? 

If legislatures and school boards 
rush to ^unfounded judgments about 
their own curriculums (based on SAT 
scores), they will be giving assent to 
• the SAT as the basis for a national 
standard. • * 

In the flnal aiialysis, it might be in 
'the best interests of public education 
to have some standards national in 
scope, but who sets those standards 
should be a subject- of thoughtful 
decision. As things stand, curriculum 
. is a primary province of thousands of 
local school boards. Who's to say that 
a few experts in the testing industry 
are bett4^ able to determine curricu- 
lum needs?. * 

And so we come full circle to the 
SAT test itself. "The panel according- 
ly commends further inquiry by the 
/Board and ETS into the function of 
tests at this critical passage point.... 
The purpose of such inquiry would be 
to identify and put ia;appropriate 
— priority whatever can be distilled from 
current national concerns^ about the 
society's educational values, aod then 
to evaluate the traditibnal tests in the 
light of that determination." 

There is just one more 'f roblem. 
There is* no time, frame, no target 
dkte, no deadline.' The need for ur- 
gency at the tranquil ETS campus in 
Princeton, New Jersey, is not the 



sa^e as in the high schopls of Balti- 
- njor^ Indianapolis, While ETS 
,moi«& »tjpiwSrd further inquiry, hun- 
^•'dr^ds c^if thousands of students', are 
beipg measured on archaic scates and 
found wanting.f □ 
. ' John Ryor , 

' l\ President, NEA 

f today's Education 
* November-December 1977 . 



ERIC 




Documents such as this are a part 
of our effort to help teachers teach* 
The size and the' complexity of the 
teaching profession are reflected in 
the range and the diversity of Ihese 
publicatwns. , , * ' 

The realities of the classroom^ and 
the problems which Jonstantly con- 
front thp professional teacher are 
often deeply (irooted in larger social, 
^ political,/ and; economic issues. For 
this reason a number ^f our publica^ 
tions, as weH some other program 
activities^ are directed at very specific 
groups within th§ profession. 
The Natiohal Education Associa-l 
' tidn works through its Instruction andJ 
Professional Development (IPD) unit/ 
to provide members with information,^^ 
serv!c(f,. and resources related to the 
Association's goal area of Profession- 
al Excellence/Eot r^iore information, 
;>write to the IPD Inforfliation Center, 
National Education Association, J20t 
16th Street,. N.:W., Washington, DC 
20036t' ' '< y 

Jqhn D. Sullivan, Director 
^ ■ NEA Instruction and 

Professional Development 



ERIC 32 



1A 




